IMAGE PROCESSING SYSTEM, PROJECTOR, PROGRAM, 
INFORMATION STORAGE MEDIUM AND IMAGE PROCESSING METHOD 



Japanese Patent Application No. 2003-61832, filed on March 7, 2003, is hereby 
5 incorporated by reference in its entirety. 

BACKGROUND OF THE INVENTION 
The present invention relates to an image processing system, projector, 
program, information storage medium and image processing method which can correct 
10 the distortion of an image and also adjust a focus. 

An image projected from an image display device such as a projector may be 
distorted to create a so-called keystone distortion in the vertical or horizontal direction, 
depending on the relationship between the image display device and a position onto 
which the image is projected therefrom. Even if the image display device is placed 
15 substantially correctly relative to an object to be projected, the image may be defocused 
when the distance between the image display device and the object to be projected 
varies. 

Thus, the image display device must display an image with no image distortion 
or defocusing. 

20 In a general projector with functions of image distortion correction and 

auto-focus, however, a user semi-automatically corrects the distortion in an image by 
indicating four comers in a screen by the use of a mouse or the like. Additionally, to 
perform the auto-focusing function in the general projector, calibration images have 
been projected after the correction of image distortion has been released once. In this 

25 case, if the projector again corrects the image distortion, the corrected projection area 
cannot be adequately focused. 

It is troublesome for the user to indicate the four comers in the screen using the 
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mouse or the like. 

To overcome such a problem, for example, Japanese Patent Laid-Open No. 
2000-241874 has proposed an automatic screen-position adjusting apparatus for 
projector which includes a projection lens capable of adjusting the focus, zooming, 
S elevation angle and tilt angle, a monitor camera located on the forward face of the main 
projector body for sensing an image projected onto a screen, data conversion means for 
converting information of image signals inputted from the monitor camera into digital 
data and storing the converted digital data, computation means for computing the 
converted digital data from the data conversion means, means for adjusting the focus of 

10 the projection lens, zooming drive means for zooming the projection lens, means for 
detecting the position of the screen within the sensed by the monitor camera, and means 
for adjusting the keystone distortion in the projected image based on the data of the 
detected screen position. 

However, the technique of Japanese Patent Laid-Open No. 2000-241874, is to 

15 project and sense a test pattern image to detect the best focus, to adjust the focus, to 
project and sense an all-white image to detect endpoint nodes on a screen, to reduce or 
magnify a projection range until the projected image reaches the endpoint nodes of the 
screen by zooming, and to adjust the orientation of the forward face of the main 
projector body or angles of depression and elevation so that the projected image is 

20 located in the center of the screen. 

This technique further examines and adjusts the keystone distortion by 
comparing the lengths of the opposed sides of the screen within the sensed image with 
each other. 

The technique of Japanese Patent Laid-Open No. 2000-241874 cannot possibly 
25 provide the best focus originally intended by the user in the keystone-distorted image 
since it corrects the keystone distortion after the focus has been adjusted once as 
described. 
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Moreover, the detection of the screen position requires a high-resolution 
camera, resulting in increase of the manufacturing cost. 

The technique of Japanese Patent Laid-Open No. 2000-241874 further adjusts 
the angles of depression and elevation in the main projector body so that the image is 
5 forcedly projected in the center of the screen taking no account of the original image 
projecting position. Such a process premises that the main projector body is located 
substantially in direct front of the screen. 

In fact, however, a laterally keystone distortion occurs if the main projector 
body is not located substantially in direct front of the screen. If the process is made 
10 presuming that the main projector body is located substantially in direct front of the 
screen, thus, the laterally keystone distortion cannot properly be corrected. 

An image intended by the user cannot be displayed if the angles of depression 
and elevation in the main projector body are adjusted so that the image is forcedly 
projected in the center of the screen taking no account of the projecting position 
15 intended by the user. More particularly, it is conceivable that the user may project an 
image on the screen only at its right half since there is an obstacle in front of the central 
screen location. 

BRIEF SUMMARY OF THE INVENTION 
20 The present invention is made in view of the above-mentioned problem and 

may provide an image processing system, projector, program, information storage 
medium and image processing method which can carry out image distortion correction 
and focus approximately at the same time without changing the projecting position 
intended by a user. 

25 To solve the above mentioned problem, an image processing system and a 

projector according to one aspect of the present invention includes: 

distortion correction means for correcting image signals to adjust the distortion 
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in an image; 

image projection means including a lens unit which has a focus adjustment 
function, the lens unit projecting an image based on the corrected image signals; 

drive control means for controlling driving of the lens unit so that a focal 
5 length of the lens unit to an image projection area changes; 

sensing means for sensing the projected image; and 

distortion correction amount deriving means for deriving the focal length to a 
center of the image projection area and deriving an amount of distortion correction for 
the distortion correction means, based on sensing information from the sensing means, 

10 wherein the distortion correction amount deriving means determines an 

optimum focal length to each of a plurality of boundary points in the image projection 
area, based on a change of luminance in a sensed image according to the sensing 
information; derives the focal length to the center of the image projection area, based on 
the optimum focal length to each of the boundary points; derives coordinates of the 

15 boundary points in a three-dimensional space, based on the optimum focal length to 
each of the boundary points and horizontal and vertical half angle-of-views in the image 
projection means; and derives the amount of distortion correction, based on the 
coordinates in the three-dimensional space, 

wherein the distortion correction means corrects the image signals, based on 

20 the derived amount of distortion correction, and 

wherein the drive control means controls the driving of the lens unit so that the focal 
length of the lens unit becomes the focal length to the center of the image projection 
area derived by the distortion correction amount deriving means . 

An image processing system and a projector according to another aspect of the 

25 present invention includes: 

a distortion correction section which corrects image signals to adjust the 
distortion in an image; 
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an image projection section which includes a lens unit which has a focus 
adjustment function, the lens unit projecting an image based on the corrected image 
signals; 

a drive control section which controls driving of the lens unit so that a focal 
5 length of the lens unit to an image projection area changes; 

a sensing section which senses the projected image; and 

a distortion correction deriving section which derives the focal length to a 
center of the image projection area and derives an amount of distortion correction 
provided by the distortion correction section, based on sensing information from the 

10 sensing section, 

wherein the distortion correction deriving section determines an optimum focal 
length to each of a plurality of boundary points in the image projection area, based on a 
change of luminance in a sensed image according to the sensing information; derives 
the focal length to the center of the image projection area, based on the optimum focal 

15 length to each of the boundary points; derives coordinates of the boundary points in a 
three-dimensional space, based on the optimum focal length to each of the boundary 
points and horizontal and vertical half £mgle-of-views in the image projection section; 
and derives the amount of distortion correction, based on the coordinates in the 
three-dimensional space, 

20 wherein the distortion correction section corrects the image signals, based on 

the derived amount of distortion correction, and 

wherein the drive control section controls the driving of the lens unit so that the focal 
length of the lens unit becomes the focal length to the center of the image projection 
area derived by the distortion correction deriving section. 
25 A program according to a further aspect of the present invention is a 

computer-readable program for causing a computer to function as: 
distortion correction means for correcting image signals to adjust the distortion in an 
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image; 

drive control means for controlling driving of a lens unit and driving of a 
sensing section, the lens unit projecting an image based on the corrected image signals 
and having a focus adjustment function for changing a focal length of the lens unit to an 
5 image projection area, and the sensing section sensing the projected image; and 

distortion correction amount deriving means for deriving the focal length to a 
center of the image projection area and deriving an amount of distortion correction for 
the distortion correction means, based on sensing information from the sensing means, 
wherein the distortion correction amount deriving means determines an 
10 optimum focal length to each of a plurality of boundary points in the image projection 
area, based on a change of luminance in a sensed image according to the sensing 
information; derives the focal length to the center of the image projection area, based on 
the optimum focal length to each of the boundary points; derives coordinates of the 
boundary points in a three-dimensional space, based on the optimum focal length to 
15 each of the boundary points and horizontal and vertical half angle-of-views in the image 
projection means; and derives the amount of distortion correction, based on the 
coordinates in the three-dimensional space, 

wherein the distortion correction means corrects the image signals, b£ised on 
the derived amount of distortion correction, and 
20 wherein the drive control means controls the driving of the lens unit so that the 

focal length of the lens unit becomes the focal length to the center of the image 
projection area derived by the distortion correction amount deriving means . 

• An information storage medium according to a still further aspect of the 
present invention stores a computer-readable program for causing a computer to 
25 function as: 

distortion correction means for correcting image signals to adjust the distortion 
in an image; 
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drive control means for controlling driving of a lens unit and driving of a 
sensing section, the lens unit projecting an image based on the corrected image signals 
and having a focus adjustment function for changing a focal length of the lens unit to an 
image projection area, and the sensing section sensing the projected image; and 
5 distortion correction amount deriving means for deriving the focal length to a 

center of the image projection area and deriving an amount of distortion correction for 
the distortion correction means, based on sensing information from the sensing means, 

wherein the distortion correction amount deriving means determines an 
optimum focal length to each of a plurality of boundary points in the image projection 
10 area, based on a change of luminance in a sensed image according to the sensing 
information; derives the focal length to the center of the image projection area, based on 
the optimum focal length to each of the boundary points; derives coordinates of the 
boundary points in a three-dimensional space, based on the optimum focal length to 
each of the boundary points and horizontal and vertical half angle-of-views in the image 
15 projection means; and derives the amount of distortion correction, based on the 
coordinates in the three-dimensional space, 

wherein the distortion correction means corrects the image signals, based on 
the derived amount of distortion correction, and 

wherein the drive control means controls the driving of the lens unit so that the 
20 focal length of the lens unit becomes the focal length to the center of the image 
projection area derived by the distortion correction amount deriving means . 

An image processing method according to a yet further aspect of the present 
invention includes: 

projecting a predetermined calibration image while changing a focal length of a 
25 lens unit; 

sensing the calibration image depending on a change in the focal length of the 
lens unit; 
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determining an optimum focal length to each of a plurality of boundary points 
in an image projection area, based on a change of luminance in a sensed image 
according to sensing information; 

deriving coordinates of the boundary points in a three-dimensional space, based 
5 on the optimum focal length to each of the boundary points and horizontal and vertical 
half angle-of-views in image projection means; 

deriving an amount of distortion correction, based on the coordinates in the 
three-dimensional space; 

correcting image signals so that distortion in the image is corrected, based on 
10 the derived amount of distortion correction; 

deriving a focal length to a center of the image projection area, based on the 
optimum focal length to each of the boundary points in the image projection area; 

changing the focal length of the lens unit so that the focal length of the lens 
unit becomes the derived focal length to the center of the image projection area; and 
15 projecting the image, based on the corrected image signals. 

The image processing system and the like can correct the distortion in the 
image by deriving coordinates in a plurality of boundary points in the three-dimensional 
space, based on a change in luminance of the image, the optimum focal length of the 
image projection area to each of the boundary points and half angle-of-views in the 
20 horizontal and vertical directions. At the same time, it can drive the lens unit so that the 
focal length of the lens unit becomes the focal length to the center of the image 
projection area, based on the optimum focal length to each of the boundary points. 

Thus, the image processing system and the like can perform the image 
distortion correction and focus adjustment approximately at the same time. 
25 With these image processing system, projector, program and information 

storage medium, the distortion correction amount deriving means may determine the 
optimum focal length, based on a luminance distribution representing a relationship 
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between luminance and number of pixels in a boundary region around each of the 
boundary points in a sensed image projection area according to the sensing information, 
on condition that the luminance distribution inside the sensed image projection area is 
different from the luminance distribution outside the image projection area. 
5 This image processing method may include determining the optimum focal 

length, based on a luminance distribution representing a relationship between luminance 
and number of pixels in a boundary region around each of the boundary points in a 
sensed image projection area according to the sensing information, on condition that the 
luminance distribution inside the sensed image projection area is different from the 

10 luminance distribution outside the image projection area. 

Thus, the image processing system and the like can perform the image 
distortion correction and focus adjustment approximately at the same time by 
determining the optimum focal length based on the distribution of luminance without 
applying any high-resolution camera. 

15 With these image processing system, projector, program, information storage 

medium, and the image processing method, the image may be rectangular, and each of 
the boundary points may be the corresponding one of vertexes of the rectangular image. 

Thus, the image processing system and the like can perform the image 
distortion correction and focus adjustment more effectively by handling the respective 

20 vertexes in the rectangular image, than a case when the whole image is to be handled. 

With these image processing system, projector, program and information 
storage medium, 

the image projection means may project a black colored image and a white 
colored image, and 

25 the distortion correction amount deriving means may determine the sensed 

image projection area, based on a difference between the sensing information for the 
black colored image and for the white colored image. 
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This image processing method may further includes: 

projecting at least a black colored image and a white colored image as the 
calibration image; and 

determining the sensed image projection area, based on a difference between 
5 the sensing information for the black colored image and for the white colored image. 

Thus, the image processing system and the like can more definitely determine 
the image projection area, based on a difference between the sensing information of a 
black colored image and the sensing information of a white colored image. 



10 BRffiF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

FIG. I is a diagrammatic view illustrating a state in which an image is 
projected. 

FIG. 2 is a diagrammatic view illustrating a processing of four comers in the 
image according to one form of this embodiment. 
15 FIG. 3 A is a diagrammatic view illustrating a focused image while FIG. 3B is a 

diagrammatic view illustrating a focused luminance distribution. 

FIG. 4A is a diagrammatic view illustrating a defocused image while FIG. 4B 
is a diagrammatic view illustrating a defocused luminance distribution. 

FIG. 5 is a functional block diagram of a projector according to one form of 
20 this embodiment. 

FIG. 6 is a hardware block diagram of a projector according to one form of this 
embodiment. 

FIG. 7 is a flow chart illustrating a flow of image processing according to one 
form of this embodiment. 
25 FIG. 8 is a flow chart illustrating a flow of sensing according to one form of 

this embodiment. 

FIG. 9 is a diagrammatic view illustrating the front of an image when an image 
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distortion occurs. 

FIG. 10 is a diagrammatic view illustrating the top of the image when the 
image distortion occurs. 

FIG. 11 is a diagrammatic view illustrating the side of the image when the 
5 image distortion occurs. 

FIG. 12 is a diagrammatic view illustrating the projection area before the image 
distortion is corrected and after the image distortion has been corrected. 

DETAILED DESCRIPTION OF THE EMBODIMENT 
10 The present invention will now be described in connection with a projector to 

which the invention is applied and which can perform the image distortion and focus 
adjustment approximately at the same time, with reference to the drawing. An 
embodiment shown in the following is not intended to limit the subject matter of the 
invention as described in the accompanying claims. All the components shown in such 
15 an embodiment is not necessarily essential for practicing the invention defined by the 
accompanying claims. 

Overall System 

FIG. 1 is a diagrammatic view illustrating a state in which an image is 
20 projected. 

A projector 20 forms a rectangular projection area 12 by projecting a 
rectangular image onto a screen 10. In this embodiment, a color light sensor 60, which 
is part of sensing means, is to sense the region of the screen 10 including the projection 
area 12. 

25 In this embodiment, the projector 20 determines the optimum focal length to 

each of the four comers (boundary points) in the projection area 12, based on a change 
of luminance in the image due to the sensing information from the color light sensor 60. 
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FIG. 2 is a diagrammatic view illustrating a processing of four comers in the 
image according to one form of this embodiment. FIG. 3A is a diagrammatic view 
illustrating a focused image; and FIG. 3B is a diagrammatic view illustrating a focused 
luminance distribution. FIG. 4A is a diagrammatic view illustrating a defocused image; 
5 and FIG. 4B is a diagrammatic view illustrating a defocused luminance distribution. 

As shown in FIG. 2, a sensed image 210 includes a region 212 corresponding 
to the projection area 12 and the other region. The projector 20 has set boundary regions 
220 to 223 to be processed which are regions in the vicinity of the aforementioned four 
comers. 

10 For example, if the image is focused, the region 212 may clearly be sectioned 

from the other region in the boundary region 222 while the luminance distribution of the 
region 212 may clearly be separated from that of the other region. 

On the other hand, if the image is defocused, the region 212 may not clearly be 
sectioned from the other region in the boundary region 222 while the luminance 

15 distribution of the region 212 may not clearly be separated from that of the other region. 

The criterion for judging whether or not one region is clearly separated from 
the other region may be a criterion forjudging whether or not the total number of pixels 
in a predetermined luminance range exceeds a threshold (i.e., whether or not the 
luminance distribution of the region 212 is separated from that of the other region) or a 

20 criterion for judging whether or not the luminance range in which the number of pixels 
does not exceed a threshold does not exceed the other threshold (i.e., that there are less 
regions which cannot be sectioned into either of the region 212 or other region). 

In such a manner, the projector 20 of this embodiment determines the optimum 
focal length to each of four comers (boundary points) in the projection area 12, based on 

25 a change of luminance in the image due to the sensing information from the color light 
sensor 60. 

In this embodiment, furthermore, the projector 20 derives the focal length to 
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the center of the projection area 12 based on these determined focal lengths; derives 
coordinates in the four comers of the projection area 12 in a three-dimensional space 
based on the determined focal lengths and half angle-of-views of the projector 20 in the 
horizontal and vertical directions; derives the amount of distortion correction based on 
5 the coordinates in the three-dimensional space; and corrects image signals based on the 
amount of distortion correction. 

Furthermore, the projector 20 controls the driving of a lens unit having a focus 
adjustment function to provide a focal length to the center P of a projection area 13 
which is provided by correcting the distortion in the projection area 12 shown in FIG. 
10 12. 

In such a manner, the projector 20 can perform the image distortion correction 
and focus adjustment approximately at the same time without changing a position in 
which an image is projected. 

15 Functional Blocks 

The functional blocks of the projector 20 for implementing such functions will 
be described blow. 

FIG. 5 is a functional block diagram of a projector 20 according to one form of 
this embodiment. 

20 The projector 20 comprises a signal input section 110 for inputting image 

signals; a distortion correcting section 120 for correcting the inputted image signals so 
that the image distortion is regulated; a signal output section 130 for outputting the 
corrected image signals; an image projecting section 190 for projecting an image based 
on the image signals; a sensing section 180 for sensing the projected image; and a 

25 distortion correction amount deriving section 140 for deriving the focal length to the 
center of the projection area 12 and also the amount of distortion correction provided by 
the distortion correcting section 120, based on sensing information. 
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The sensing section 180 comprises a lens unit 184 having a focus adjustment 
function and a light-receiving section 182 for receiving light from the lens unit 184. 

The image projecting section 190 comprises a spatial light modulator 192, a 
drive section 194 for driving the spatial light modulator 192, a light source 196 and a 
5 lens unit 198 having a focus adjustment function. 

The drive section 194 drives the spatial light modulator 192 based on image 
signals from the signal output section 130. The image projecting section 190 projects 
light from the light source 196 through the spatial light modulator 192 and lens unit 
198. 

10 The projector 20.ftirther comprises a focus lens driving section 162 ftmctioning 

as part of a drive control means and for driving the lens units 184 and 198; an image 
analysis section 170 ftmctioning as part of a distortion correction amount deriving 
means and for analyzing the sensing information; a control section 160 ftmctioning as 
part of the drive control means and for controlling the focus lens driving section 162 

15 based on the sensing information; and a calibration image generating section 150 for 
generating calibration images used for correction. 

Hardware for implementing the respective sections of the aforementioned 
projector 20 into a computer may be realized by the following components. 

FIG. 6 is a hardware block diagram illustrating a projector 20 according to one 

20 form of this embodiment. 

For example, the signal input section 110 may be implemented into the 
computer by using an A/D converter 930 or the like; the distortion correcting section 
120 may be implemented into the computer by using an image processing circuit 970, 
RAM 950, CPU 910 or the like; the signal output section 130 may be implemented into 

25 the computer by using a D/A converter 940 or the like; the calibration image generating 
section 150 and image analysis section 170 may be implemented into the computer by 
using the image processing circuit 970, RAM 950 or the like, the control section 160 
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and focus lens driving section 162 may be implemented into the computer by using the 
CPU 910, RAM 950 or the like; the sensing section 180 may be implemented into the 
computer by using a CCD camera; and the spatial light modulator 192 may be 
implemented into the computer by using a liquid crystal panel 920, a ROM 960 for 
5 storing a liquid crystal light valve driver for driving the liquid crystal panel 920 or the 
like. 

These sections may be configured to mutually deliver the information 
therebetween through a system bus 980. The color light sensor 60 is part of the sensing 
section 180. 

10 These sections may partially or wholly be implemented into a computer in 

hardware manner such as circuits or software manner such as drivers. 

Furthermore, the functions of the distortion correcting section 120 and the like 
may be implemented into the computer by reading a program for causing the computer 
to function as the distortion correcting section 120 and the like from an information 

15 storage medium 900 in which the program has been stored. 

Such an information storage medium 900 may be implemented, for example, 
by CD-ROM, DVD-ROM, ROM, RAM, HDD or the like. Furthermore, the program 
stored in the information storage medium 900 may be read in either of contact or 
non-contact manner. 

20 The aforementioned functions may be implemented into the computer by 

downloading a program for implementing the above functions into the computer or the 
like from a host device or the like through transmission channel, in place of the 
information storage medium 900. 

Next, the flow of image processing using these sections will be described 

25 below, 

FIG. 7 is a flow chart illustrating a flow of image processing according to one 
form of this embodiment. 
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First of all, a user activates the projector 20 which in turn projects calibration 

images. 

In an initial state, the control section 160 and focus lens driving section 162 
controls the lens units 184 and 198 to minimize the focal lengths of the lens units 184 
5 and 198 (step SI). 

The projector 20 then executes the sensing process (step S3) until the focal 
lengths are maximized (step S2). 

FIG. 8 is a flow chart illustrating a flow of image processing according to one 
form of this embodiment. 
10 The projector 20 judges whether or not it is the first time. If it is the first time, a 

calibration image generating section 150 generates an all-black calibration image, and 
the image projecting section 190 projects the all-black calibration image (step Sll). 

The sensing section 180 senses a screen 10 onto which the all-black calibration 
image is projected (step SI 2). 
15 The calibration image generating section 150 also generates an all-white 

calibration image and the image projecting section 190 projects the all-white calibration 
image (step SI 3). 

The sensing section 180 senses the screen 10 onto which the all-white 
calibration image is projected (step S14). 

20 The projector 20 then judges whether or not it is the first time (step S15) and 

selects a projection area only in the case of the first time (step S16). More particularly, 
the image analysis section 170 determines between a region 212 corresponding to the 
projection area 12 and the other region, based on a difference between the sensing 
information for the all-white calibration image and the sensing information for the 

25 all-black calibration image. The image analysis section 170 can identify boundary 
regions 220 to 223 in the subsequent process by having stored the information. 

The image analysis section 170 then detects the luminance distribution around 
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the region 212 at its four comers (step S17). The sensing section 180 may output the X, 
Y and Z values of an image as sensing information and the image analysis section 170 
may detect the luminance distribution by handling Y-V£ilue among the X, Y and Z 
values as luminance. 

5 It is to be noted that the X, Y and Z values are tristimulus values in the device 

independent type XYZ colorimetric system which is established by the Commission 
Internationale de I'Eclairage (CIE). In the XYZ colorimetric system, the Y-value can be 
handled as luminance value. 

The control section 160 and focus lens driving section 162 controls the lens 
10 units 184 and 198 to change the focal lengths of the lens units 184 and 198 at regular 
intervals (step SIS). 

When the focal lengths are maximized during the above-mentioned sensing 
process (step S3), the image analysis section 170 detects distances from the projector 20 
to the four comers of the projection area 12, based on the focal lengths stored in the 
15 control section 160 and the luminance distributions stored in the image analysis section 
170 (step S4). 

The control section 160 then transfers the information to the distortion 
correction amount deriving section 140. The distortion correction amount deriving 
section 140 then derives the amount of distortion correction, based on the distances to 
20 the four comers of the projection area 12 (step S5). 

A process of deriving the amount of distortion correction will be described 
more in detail. 

FIG. 9 is a diagrammatic view illustrating the front of an image when an image 
distortion occurs. FIG. 10 is a diagrammatic view illustrating the top of an image when 
25 an image distortion occurs. FIG. 11 is a diagranmiatic view illustrating the side of an 
image when an image distortion occurs. FIG. 12 is a diagrammatic view illustrating a 
projection area 12 before its image distortion is corrected and a projection area 13 after 
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its image distortion has been corrected. 

It is assumed, for example, that a virtual three-dimensional space has its origin 
O through which a horizontal X-axis, a vertical Y-axis and a Z-axis orthogonal to the X 
and Y axes extend. 

When it is assumed that the horizontal and vertical half angle-of-views in the 
projector 20 is 9h and 9v and that the focal lengths to the respective four comer points A, 
B, C and D are LI, L2, L3 and L4 (cm or other unit), respectively, the coordinates of the 
points A, B, C and D in the three-dimensional space can be determined by using the 
following trigonometric functions. 

A: (XI, Yl, Zl) = (-L1 * tan(0h), LI * tan(0v), LI); 

B: (X2, Y2, Z2) = (-L2 * tan(0h), -L2 * tan(ev), L2); 

C: (X3, Y3, Z3) = (L3 * tan(eh), -L3 * tan(0v), L3); and 

D: (X4, Y4, Z4) = (L4 * tan(0h), L4 * tan(0v), L4). 

A vector N perpendicular to the screen 10 is then determined using coordinate 
information for any three of the points A, B, C and D. The calculation of the coordinate 
information for the points A, C and D will be exemplified here. 

N = (Xn, Yn, Zn); 

Xn = (Y4 - Y3) * (Zl - Z4) (Z4 - Z3) * (Yl - Y4); 
Yn = (Z4 - Z3) * (XI - X4) - (X4 - X3) * (Zl - Z4); and 
Zn = (X4 ^ X3) * (Yl - Y4) - (Y4 - Y3) * (XI - X4). 

This vector N is then used to determine an angle included between the screen 
10 and the projector 20, a horizontal half angle-of-view 0x and a vertical half 
angle-of-view 0y. 

0x = atan (Xn/Zn); and 

0y = atan (Yn/Zn). 

The angle information 0x and 0y are then used to obtain coordinates A B', C ' 
and D* in a liquid crystal light valve corrected with respect to its image distortion at the 
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four comers from a table in which the angle information 0x and 9y have been associated 
with the amounts of correction in the x and y coordinates on the corrected liquid crystal 
light valve at the four comers thereof 

In such a manner, the image analysis section 170 can derive the amounts of 
5 correction based on the focal lengths LI, L2, L3 and L4 to the respective four comer 
points A, B, C and D (step S5). 

The image analysis section 170 further computes a distance L5 to the center P 
of a frame represented by four comer coordinates E, F, G and H in the projection area 
13 corrected with respect to its image distortion and shown in FIG. 12, based on the 

10 central coordinate position of a frame represented by coordinates A B*, C * and D' 
indicative of a region corrected with its image distortion on the liquid crystal light valve 
and the actual distances LI to L4 between the four comer coordinates A, B, C and D 
and the projector 20 (step S6). 

The control section 160 and focus lens driving section 162 then control the lens 

15 unit 198 so that the focal length of the lens unit 198 becomes equal to L5 (step S7). 

In such a manner, the distortion correcting section 120 corrects image signals 
from the input signal processing section 110 with an amount of correction by which the 
keystone distortion is corrected, and the image projecting section 190 projects an image 
adjusted with respect to its focal length, based on the corrected image signals (step S8). 

20 As described, the projector 20 of this embodiment can correct the image 

distortion by deriving the coordinates of the four comers in the three-dimensional space, 
based on the change of luminance in the image, the optimum focal length to each of the 
four comers in the projection area 12 and the horizontal and vertical half angle-of- views 
while at the same time, it can drive the lens unit 198 to provide the focal length to the 

25 center of the projection area 12, based on the respective one of the optimum focal 
lengths. 

Thus, the projector 20 can perform the image distortion correction and focus 
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adjustment approximately at the same time. 

According to this embodiment, the projector 20 can also perform the image 
distortion correction and focus adjustment approximately at the same time by 
determining the optimum focal length based on the distribution of luminance without 
5 applying any high-resolution camera. 

According to this embodiment, furthermore, the projector 20 can perform the 
image distortion correction and focus adjustment more effectively by handling the 
respective vertexes in the rectangular image, in comparison with a case when the whole 
image is to be handled. 

10 Since the color light sensor 60 functioning as part of the sensing section 180 

will not detect directly any position, but may be lower in the resolution, the projector of 
the present invention may be produced with a reduced manufacturing cost. 

Modifications 

15 Although the embodiment of the present invention has been described, the 

present invention is not limited to the aforementioned forms. 

The above embodiment has been described as to the derivation of the distortion 
amount correction using the table in which the amounts of distortion correction are 
associated with the values 0x and 9y. According to a modification of this embodiment, 

20 the projector 20 may be configured to use another table in which the three-dimensional 
coordinates for the four comer points A, B, C and D are associated with the amounts of 
correction. Thus, the projector 20 can determine the amounts of distortion correction 
without determining the values 9x and 0y. In addition, since the table used may be of 
two-dimensional structure using the values 0x and 9y as search keys in the system using 

25 these values, the table can be simplified in comparison with the system using the 
three-dimensional coordinates for the four comer points, thereby providing a further 
advantage by which the projector may be utilized for a so-called tele-wide (zoom and 
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magnification) system. 

Although the embodiment of the present invention has been described as to the 
repeated projecting, sensing and processing of the calibration images while changing the 
focal length from the minimum to maximum values, the projector 20 may be configured 
to finish all the handlings of the calibration images including the projection and the like 
at a point of time when the optimum focal lengths at the four comers of the projection 
area 12 have been detected. 

The present invention is also effective for other image processing systems 
using various types of light sources such as CRTs (Cathode Ray Tubes), LEDs (Light 
Emitting Diodes) and the like, in addition to the projector 20. 

The projector 20 may be in the form of a liquid crystal projector or a projector 
using a Digital Micromirror Device (DMD). DMD is a trademark possessed by Texas 
Instruments Incorporated in the U. S. 

Additionally, the functions of the projector 20 may be accomplished by a single 
projector or by a plurality of decentralized processing device (e.g., one projector and 
one PC). 
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